Goto

Collaborating Authors

 phase imaging


Detecting immune cells with label-free two-photon autofluorescence and deep learning

Kreiss, Lucas, Chaware, Amey, Roohian, Maryam, Lemire, Sarah, Thoma, Oana-Maria, Carlé, Birgitta, Waldner, Maximilian, Schürmann, Sebastian, Friedrich, Oliver, Horstmeyer, Roarke

arXiv.org Artificial Intelligence

Label-free imaging has gained broad interest because of its potential to omit elaborate staining procedures which is especially relevant for in vivo use. Label-free multiphoton microscopy (MPM), for instance, exploits two-photon excitation of natural autofluorescence (AF) from native, metabolic proteins, making it ideal for in vivo endomicroscopy. Deep learning (DL) models have been widely used in other optical imaging technologies to predict specific target annotations and thereby digitally augment the specificity of these label-free images. However, this computational specificity has only rarely been implemented for MPM. In this work, we used a data set of label-free MPM images from a series of different immune cell types (5,075 individual cells for binary classification in mixed samples and 3,424 cells for a multi-class classification task) and trained a convolutional neural network (CNN) to classify cell types based on this label-free AF as input. A low-complexity squeezeNet architecture was able to achieve reliable immune cell classification results (0.89 ROC-AUC, 0.95 PR-AUC, for binary classification in mixed samples; 0.689 F1 score, 0.697 precision, 0.748 recall, and 0.683 MCC for six-class classification in isolated samples). Perturbation tests confirmed that the model is not confused by extracellular environment and that both input AF channels (NADH and FAD) are about equally important to the classification. In the future, such predictive DL models could directly detect specific immune cells in unstained images and thus, computationally improve the specificity of label-free MPM which would have great potential for in vivo endomicroscopy.


Calibration-free quantitative phase imaging in multi-core fiber endoscopes using end-to-end deep learning

Sun, Jiawei, Zhao, Bin, Wang, Dong, Wang, Zhigang, Zhang, Jie, Koukourakis, Nektarios, Czarske, Juergen W., Li, Xuelong

arXiv.org Artificial Intelligence

Fiber endoscopes have emerged as a vital tool for highresolution Recent advancements have adopted deep learning techniques microscopic imaging in hard-to-reach areas. In contrast to expedite the QPI image reconstruction process [12, 13]. Moreover, to conventional endoscopes with a typical diameter of extant literature indicates the potential of decrypting an several millimeters, fiber endoscopes, which could be submillimeter encoded phase directly from speckle images utilizing deep learning, thin and flexible [1-5], can pass through the organ's although only in simulated environments [14]. This demonstrates intricate pathways without causing harm inside the body [6], the theoretical possibility of reconstructing the original making them particularly suitable for procedures requiring utmost phase directly from speckle images using deep learning for MCF precision and minimal invasiveness. The reduced size and phase imaging, however, networks trained on simulated data adaptability of fiber endoscopes ensure less discomfort for the can hardly achieve accurate phase reconstructions in real-world patient, leading to quicker recovery times and a lower risk of optical systems.

  Country:
  Genre: Research Report (0.40)
  Industry: Health & Medicine (0.48)

This AI-augmented microscope uses deep learning to take on cancer » Behind the Headlines

#artificialintelligence

According to the American Cancer Society, cancer kills more than 8 million people each year. Early detection can boost survival rates. Researchers and clinicians are feverishly exploring avenues to provide early and accurate diagnoses, as well as more targeted treatments. Blood screenings are used to detect many types of cancers, including liver, ovarian, colon and lung cancers. Current blood screening methods typically rely on affixing biochemical labels to cells or biomolecules.